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A METHOD AND A SYSTEM FOR IMPROVING RESOLUTION In COLOR 
IMAGE DATA GENERATED BY A COLOR IMAGE SENSOR 

This is a divisional of prior application Serial No. : 
09/004,151 filed on January 7, 1998 under 35 CFR 1.53(b) 

Field of the Invention 

The current invention is generally related to a method 
and a system for improving the resolution of color image 
data in image reproduction machines such as a digital camera 
and a digital scanner, and more particularly related to the 
method and the system for independently estimating an 
intensity value based upon chromaticity values as well as 
measured sensor values . 

BACKGROUND OF THE INVENTION 

In image reproduction machines including a digital 
camera and a digital scanner, an image photo sensor such as 
a capacitor coupled device (CCD) includes a group of color- 
component specific photo elements. These color- component 
specific photo elements are arranged in a predetermined 
spatial pattern on a single plane. For example, FIGURE 1A 
illustrates a one -dimensional photo sensor element strip, 
and a set of red (R) , green (G) and blue (B) color- component 
specific photo sensitive elements is repeated in one 
dimension. FIGURE IB illustrates a two-dimensional photo 
sensor, and one exemplary spatial pattern unit of RGB photo 
elements each consists of five G-sensitive photo elements, 
two R-sensitive photo elements and two B-sensitive photo 
elements. These spatially distributed RGB photo sensors 
generate an image for respective pixels. 
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Now referring to FIGURE 2, the above described one- 
dimensional single-layer RGB photo sensor array unit 
generates only one color value for the corresponding CCD or 
CCD data. The CCD data is processed to ultimately generate 

three sets of color values for each pixel or CCD in a color 
image. In particular, the one -dimensional single-layer RGB 
photo sensor array unit initially generates spatially 
distributed RGB values or CCD data. For example, since In- 
sensitive photo sensor elements are located at the first and 
fourth positions in the array unit, the R CCD data is 
available only at these two positions. Similarly, G CCD 
data is available only at the second and fifth positions 
while B CCD data is available at the third and sixth 
positions. Based upon the above described fragmented CCD 
data, the three sets of contiguous color values are 
generated according to a predetermined process such as 
interpolation for an improved color image. 

The above described image photo sensor units generally 
have two undesirable features. One of the undesirable 
features is caused by the spatial location of the RGB photo 
elements on a single plane. Since the RGB photo sensors are 
not stacked on top of each other at an identical location 
with respect to an object image to be reproduced, an exact 
location of the object image that each of these RGB photo 
elements reproduces is not identical. In other words, each 
of the RGB elements generates a slightly different portion of 
the object image. Because of this spatial distribution of 
the photo sensors, the reproduced object image is somewhat 
distorted in its colors. 

The other undesirable feature is related to 
resolution. Since color at one pixel is determined based 
upon a set of color- component specific photo elements such as 
a set of RGB elements, the resolution of the reproduced 
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image is reduced by a number of photo elements required for 
one pixel in determining color. In contrast, if an 
achromatic image is reproduced, since each pixel directly 

corresponds to a portion of an output image, the resolution 
is directly related to the number of photo elements. 

To solve the above described problems, prior attempts 
include Japanese Laid Open Publication Hei 2-153 679 which 
discloses a method of interpolating pixel color output 
values. Referring to FIGURE 2, the R color- component values 
are interpolated in a one -dimensional single plane photo 
sensor strip as shown in FIGURE 1A. Since the R photo 
sensors exist only at positions 1 and 4, the R values are 
interpolated at positions 2 and 3 based upon the R output 
values at the positions 1 and 4 . The following equations 
(1) : 



R(2) _ 2R(1) + R(4) 



R(3) _RQ)*2R(4> 



Similar interpolation is performed for other color 
components . Although the above interpolation method somewhat 
improves color distortion, because the interpolated values 
are always within a range of actually measured values, the 
improved output range is still limited to the measured range. 

Another prior art attempt, Japanese Laid Open 
Publications Hei 2-239791 and Hei 7-123421 disclose methods 
for increasing resolution in image reproduction. The methods 
assume that a set of color -component specific photo sensors 
each has identical response sensitivity to achromatic- light 
and that an image is achromatic. The intensity output from 
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each photo sensor is now used for generating an image thereby 
increasing resolution. For example, referring to FIGURE 3, 
even though individual photo elements are color- component 
specific such as R, G and B, only monochromatic intensity is 

considered. However, when the sensitivities are not 
identical and or the image is not achromatic, the 
sensitivities may be adjusted for a particular color 
component if relative color- component sensitivity response 
curves of the photo elements are known. The above described 
approach is useful only for a single color-component output 
and is not practical for chromatic images in general. 

In order to avoid the above described unresolved 
problems in improving the resolution of an image generated by 
the single-plane color photo sensor, it is desired to process 
photo sensor signals according to a predetermined spatial 
distribution pattern of the color-component. Furthermore, it 
remains desirable to process the photo sensor signals in such 
a way to generate intensity signals which substantially 
improve the above described color distortion problem. 

SUMMARY OF THE INVENTION 

In order to solve the above and other problems, 
according to a first aspect of the current invention, a 
method of improving resolution in color image data, includes 
the steps of: a) inputting color image data from a sensor 
having a specific unit pattern of color-component specific 
photo elements; b) generating chroma values for each of the 
color-component specific elements from the color image data; 
c) adjusting the chroma values according to the specific 
pattern of the color-component specific elements; and d) 
estimating an intensity value based upon the chroma values 
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adjusted in the step c) and the color image data from the 
step a) . 

According to a second aspect of the current invention, 
a system for improving resolution in color image data, 
includes: a single-plane color image sensor having a 

predetermined spatial pattern of color- component specific 
photo elements for generating color image data; an 
interpolated chroma value generator connected to said single- 
plane color image sensor for generating interpolated chroma 
values according to the spatial pattern; and an intensity 
estimator connected to the interpolated chroma value 
generator and the single-plane color image sensor for 
estimating an intensity value based upon the interpolated 
chroma values and the color image data. 

According to a third aspect of the current invention, 
a program storage device readable by a machine, tangibly 
embodying a program of instructions executable by the machine 
to perform method steps of reproducing a high-resolution 
image, the method steps including: j) inputting color image 
data from a sensor having a specific unit pattern of color- 
component specific photo elements; k) generating chroma 
values for each of the color- component specific elements from 
the color image data; 1) adjusting the chroma values 
according to the specific pattern of the color- component 
specific elements; m) further adjusting the chroma values for 
smoothing the chroma values adjusted in the step 1) ; n) 
estimating an intensity value based upon the chroma values 
twice adjusted in the steps 1) and m) and the color image 
data from the step j); o) adjusting the intensity value for 
an improved edge characteristic after the step n) ; and p) 
generating RGB data based upon the chroma values adjusted in 
the step m) and the intensity value adjusted in the step o) . 
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These and various other advantages and features of 
novelty which characterize the invention are pointed out with 
particularity in the claims annexed hereto and forming a part 
hereof. However, for a better understanding of the 
invention, its advantages, and the objects obtained by its 
use, reference should be made to the drawings which form a 

further part hereof, and to the accompanying descriptive 
matter, in which there is illustrated and described a 
preferred embodiment of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIGURES 1A and IB respectively illustrate one- 
dimensional and two-dimensional single layer photo sensor 
units . 

FIGURE 2 illustrates that a one dimensional single 
layer photo sensor unit generates measured CCD data and the 
CCD data is interpolated for each color- component . 

FIGURE 3 illustrates exemplary R values from a photo 
sensor unit and the interpolation of the measured R values at 
G and B photo sensor element positions. 

FIGURE 4 illustrates exemplary mono chromatic 
intensity values at every sensor element position. 

FIGURE 5 is a block diagram illustrating a first 
preferred embodiment of the color resolution improving system 
according to the current invention. 

FIGURE 6 illustrates how an undesirable feature in 
color components occurs near an edge area. 

FIGURE 7 is a block diagram illustrating a second 
preferred embodiment of the color resolution improving system 
according to the current invention. 
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FIGURE 5 is a block diagram illustrating a third 
preferred embodiment of the color resolution improving system 
according to the current invention. 

FIGURE 9 illustrates a range of neighboring photo 
sensor elements which are taken into account in improving 
color image resolution. 

FIGURE 10 is a flow chart illustrating steps involved 
in a method of improving color image resolution according to 
the current invention. 

FIGURE 11 is a block diagram illustrating a fourth 
preferred embodiment of the color resolution improving system 
according to the current invention. 

FIGURES 12A, 12B and 12C respectively illustrate an 
exemplary photo sensor unit, a set of corresponding filters 
or masks and a table summarizing a combination of the masks 
used in interpolating the sensor values. 

FIGURES 13A, 13B and 13C respectively illustrate an 
exemplary photo sensor unit and two filter masks for 
converting sensor values into chroma values . 

FIGURE 14 is a block diagram illustrating a system for 
improving color resolution including a program storage device 
readable by a machine and tangibly embodying a program of 
instructions executable by the machine to perform method 
steps of reproducing a high-resolution image. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT ( S ) 

Referring now to the drawings, wherein like reference 
numerals designate corresponding structure throughout the 
views, and referring in particular to FIGURE 4, one preferred 
embodiment of the color image improving system according to 
the current invention includes an image data input unit 110, 
an interpolation unit 12 0, a chroma value generation unit 
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130, a smoothing filter unit 140, an intensity estimation 
unit 150 and an output unit 160. The image data input unit 
110 includes a single-plane photo sensor consisting of photo- 
sensitive elements such as capacitor-coupled devices (CCD) . 
These CCDs are arranged in a predetermined spatial pattern on 

a single plane and generally each generate respective color- 
component specific signals such as RGB signals. The spatial 
pattern is either one -dimensional or two-dimensional. One 
example of the two-dimensional spatial pattern of the RGB 
photo elements is illustrated in FIGURE IB. 

Still referring to FIGURE 4, the interpolation unit 
12 0 interpolates RGB values in pixels whose color- component 
values are not measured. One preferred embodiment of the 
interpolation unit 120 according to the current invention 
interpolates the unmeasured values based upon adjacent 
measured values . One exemplary step of determining the 
interpolation values takes an average of the adjacent values. 

Another exemplary step of determining the interpolation 
values applies a predetermined mask or filter according to a 
specific pattern of the color- component specific elements to 
a measured value. Although the filter may be applied to 
measured RGB values or chroma CrCb values, the preferred 
embodiment interpolates the RGB values. 

After the R0, GO and B0 values are interpolated to R, 
G and B values, a chroma value generation or chromaticity 
conversion unit 13 0 further converts the interpolated values 
RGB values to chroma values CrO and CbO . One preferred 
embodiment of the chroma value generation unit 13 0 includes a 
2x3 matrix containing coefficients which spatially 
correspond to a specific set of color- component photo sensor 
elements. One example of the matrix multiplication is 
described in the following equation (2) for enabling a 
conversion between the NTS C- RGB and Cr-Cb color space. 
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100R-Y 



100B-Y 



] 



where RGB values range from 0 to 1 while Y ranges from 0 to 
100. Furthermore, XYZ is defined as follows in an equation 



Where M is a 3 x 3 matrix. From the above equations (2) and 
(3), the relationship between the RGB and YCrCb values is 
described as follows in the following equation (4) : 



where N is also a 3 x 3 matrix of coefficients. These 
coefficients are one exemplary set of values, and the matrix 
N is not limited to these particular values. Finally, CrO 
and CbO are determined more directly by the following 
equation (5) . 



(3) . 



60.69927 17.34486 20.05713 



[Y] =M [G],M = [29.89665 58.64214 11.46122] ...(3) 
Z B 0.00000 6.607565 111.7469 



29. 89665 58. 64214 11. 461 22 



[Cr] =N [G],N= [ 70.10335 - 56.64214 - 1 1.46122 J ...(4) 
Cb B -29.89665 -58.64214 88.53878 
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CrO = nn Rl + n 22 Gl + n « ^7 

CbO = mi Rl + nnGl + ns3Bl ...(5) 

where nij is an element in the N matrix in the above equation 
(4) . 

Still referring to FIGURE 4, in a preferred embodiment 
of the current invention, a smoothing filter unit or a low 
pass filter 14 0 generally smooths out the converted chroma 

values CrO and CbO in the image data. However, the smoothing 
filter unit 140 is not limited to the chroma values, and it 
is implemented to be applied to RGB values in an alternative 
embodiment. The smoothing filter unit 140 is particularly 
effective on smoothing color output near edges. After the 
chroma values for each pixel are processed in the above 
described edge process, the intensity estimation unit 150 
estimates an intensity value based upon the chroma values as 
well as the original RGB values from the image data input 
unit 110. In general, the intensity estimation unit 150 
estimates the intensity value independently for each photo 
sensor position. In other words, the spatial arrangement of 
the color- component specific photo sensors are accounted for 
the intensity estimation. As a result, the intensity values 
range in a spectrum equal to that of entire photo sensors. 

In order to accomplish the above described tasks, the 
intensity estimation unit 150 solves for Y in the above 
equation (4) which relates the RGB and YCrCb color space. 
The intensity Y at a R color- component specific photo sensor 
position is determined as in the following set of equations 
(6) : 
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Y = arRO + brCr + crCb 



or -(nn + ) 



n?2ri33 ~ rt23n32 



ni3ri22 " nnri23 
cr 

Yl22 ri33 - n 2 3 Yl32 



..(6) 



where RO, Cr and Cb are known variable while Y, G and B are 
unknown variable. n i:j is an element in the N matrix in the 
above equation (4) . 

Similarly, the intensity Y at a G color- component 
specific photo sensor position is determined as in the 
following set of equations (7) : 



Y = agGO + bgCr + cgCb 



-/ ^n }3 ( H22 n3i -n2iri 32) + nu(n23n32 ~ nn nx) > 
ag - ( ni2 + ) 

Yl2in33-n 2 3 ri3! 



bg = minis' ni3Yi3i 

ri2iri33^ N 23T131 



1121 ri33 - n 2 3ri3i 



where GO, Cr and Cb are known variable while Y, R and B are 
unknown variable. n ±6 is an element in the N matrix in the 
above equation (4) . 
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Lastly, the intensity Y at a B color- component 
specific photo sensor position is determined as in the 
following set of equations (8) : 



Y = abBO + bbCr + cbCb 



* _ z _j_ nn( n 2 3nit- n 2 i nn) + nn ( nii n^rnn rin) > 



bb 



_ nnnn - n/2ftj/ 
ri2iri32 ~ ri22ri3i 



cb= n » n * _ (8 ) 



where BO, Cr and Cb are known variable while Y, R and G are 
unknown variable. n i:j is an element in the N matrix in the 
above equation (4) . 

The above equation sets (6) -(8) are each solved for 
the intensity value Y by simple additions provided that 
respective coefficients (ar, br, cr) , (ag, bg, eg) and (ab, 
bb, cb) are precalculated. In one preferred embodiment 
according to the current invention, the intensity estimation 
unit 150 stores the above three sets of the coefficients and 
selects one of the sets depending upon the position of the 
color- component specific photo sensor. Thus, based upon the 
R0, BO and GO signals and the chromaticity values Cr and Cb, 
the intensity estimation unit 150 estimates the intensity 
values, and the output unit 160 outputs the improved Y, Cr 
and Cb signals . 

Now referring to FIGURE 5, areas such as an edge 
suddenly change in intensity, and the interpolation in these 
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areas is not generally accomplished in an esthetically 
pleasing manner. Color- component specific photo sensors 190 
are positioned in one dimension near an edge 701. Only 
intensity values of these photo sensors 190 are considered. 
Filled circles, squares and triangles respectively represent 
actual intensity values of R, G and B photo sensors while 
unfilled circles, squares and triangles respectively 

represent interpolated R, G and B values. Near positions 2 
through 5, the intensity values of the interpolated R, G and 
B values differ and have a color relation such as R > G > B . 

Consequently, near the edge, since the intensity values 
differ among the color components, inaccurate colors or 
intensities are reproduced. In order to substantially 
eliminate the above color- component discrepancy near edge 
areas, in one preferred embodiment according to the current 
invention, a smoothing filter unit includes a spatial filter 
whose function is described by the following equations (9) . 

i + 3 

Cn = 2 CrOj/7 
j = i-3 



i + 3 

Cbi = I CbOj/7 ...(9) 
7 = /-5 

The above described digital filter smooths the intensity 
values of an edge area including seven contiguous pixels 
which are symmetrically taken from both left and right sides. 

Referring to FIGURE 6, a second preferred embodiment 
of the color image improving system according to the current 
invention includes an image data input unit 110, an 
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interpolation unit 120, a chroma value generation unit 130, a 
smoothing filter unit 140, a RGB value estimation unit 170 
and an output unit 18 0. In the second embodiment, the G and 
B values are estimated assuming that Cr, Cb and R0 in the 
above equation are known variables. G and B values at a R 
color- component specific photo sensor position are determined 
based upon the following set of equations (10) : 

G = ( ( nil n33 ~ ri23 mi) " n 33 Cr + ni3 Cb) 

ri23 ri32 - nil 1233 



B ( ( U22 mi ~ mi 1232) + ri32 Cr - 1122 Cb) 

1123 ri32~ n22fl33 

...(10) 



where n tj is an element in the N matrix in the above equation 
(4) . Similarly, the R and B values are estimated assuming 
that Cr, Cb and GO in the above equation are known variables. 

R and B values at a G color- component specific photo sensor 
position are determined based upon the following set of 
equations (11) : 



R ( ( n22 ns3 - n23 n3 2) CO - TI33 Cr + ri23 Cb) 

n 2 3ri3i - mim3 



B = ( ( YI21 ri32 - 1122 n3i ) CO + n3} Cr - n21 Cb) 

n 2 3mi' n 2 iri33 

....(11) 



where n i:j is an element in the N matrix in the above equation 
(4) . Lastly, the R and G values are estimated assuming that 
Cr, Cb and B0 in the above equation are known variables. R 
and G values at a B color- component specific photo sensor 
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position are determined based upon the following set of 
equations (12) : 



R = 



n?ins2 ~ nunu 



((ri22 ri3s - ri23 nn) BO - nn Cr + n 22 Cb) 



G = 



n 2 iri32- ri22nsi 



( ( ri23 mi - ri2i tin) BO + n 3 i Cr - r\2i Cb) 

...(12) 



where n i;} is an element in the N matrix in the above equation 
(4) . Thus, based upon the RO , BO and GO signals and the 
chromaticity values Cr and Cb, the RGB estimation unit 170 
estimates the RGB values, and the output unit 18 0 outputs the 
improved RGB signals . 

Referring to FIGURE 7, a third preferred embodiment of 
the color image improving system according to the current 
invention includes an image data input unit 110, a position 
counter 330, a coefficient set storage unit 310, a processing 
unit 320 and an output unit 340. The coefficient set storage 
unit 310 stores three sets of the coefficients. The position 
counter 330 determines a pixel position in question to be one 
of the color- component specific photo sensor positions based 
upon the number of counts on pixels and selects a 
corresponding one of the coefficient sets. The selected 
coefficient set is inputted into the processing unit 320. 
The processing unit 320 determines RGB values for each of the 
color-component specific RGB photo sensors at a photo sensor 
position i. In other words, the processing unit 320 takes 
the photo sensor position i into account in determining the 
RGB values. 

Now referring to FIGURE 9, to determine RGB values, 
for example, in reference to a R photo sensor at a position 
N, photo sensor values from positions ranging from a first 
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position N-3 to a second position N+3 are considered. In 
order to interpolate R values, a first set of R values 
ranging from a third position N-5 to a fourth position N-l 
are considered while a second set of R values ranging from a 

fifth position N+5 to a fourth position N+l are considered. 
In other words, in order to generate color image data in 
reference to the R photo sensor at the position N, eleven 
photo sensor values are considered. According to this 
preferred process, the RGB values the photo sensor at the 
position N are directly obtained from the above equations 
(1) , (5), (6) and (10) through (12). 

To determine the RGB values of a pixel in question 
which corresponds to a R photo sensor at a position i, the 
following set of equations (13) describes the relations: 



G 7^z — (-X0 i -3--X0i + ~K0 i+ 3) 

n 2 3n32' n sub22n 3 3 7 7 7 



+ (~] G Ow + fj G Oi-2 + |t? 0 i+1 + 0 i+4 ) 



B - gg "» ' 52 *" ( 2 - R 0,3 - 4 -R0-Ar 0,3) 

ri23 fl32 ' Yl22 fl33 7 7 7 



+ (~ b o, 4 -Ibom+Yj 8 0i ' 2 *Ti B 0i+s) 



.(13) 



where n ± . is an element in the N matrix in the above equation 
(4) . Assuming that a pixel in question is ROi, surrounding 
pixels include ROi-3, R0i+3, G0i-5, G0i-2, G0i+1, GOi+4, BOi- 
4, BOi-1, B0i+2 and B0i+5, and the surrounding pixels are 
used to generate a product sum. 
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Similarly, to determine the RGB values of a pixel in 
question which corresponds to a G photo sensor at a position 
i, the following set of equations (14) describes -the 
relations : 



R = (jR 0u4 +jROi., + -jjR 0 i+2 + Yi R 



, ri33 Y122 + ri23 ni2 ,2 n 4 2 

+ ( —GOi-3 - -G0i + -G0 i+ 3) 

ri33ri3i- ri2iri33 7 7 7 



B = ( 2 G0 ,s --G 0i + 2 -G 0m ) 

ri23nsr ri2inss 7 7 7 



+ (jj B 0,. s + y 1 B 0,-2 + jB o», + ^B 0 i+ J 



.(14) 



where n fj is an element in the N matrix in the above equation 
(4) . 

Lastly, to determine the RGB values of a pixel in 
question which corresponds to a B photo sensor at a position 
i, the following set of equations (15) describes the 
relations : 
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(^BOt-s-iBOi + ^BOi+j) 




- nsiri23 + n 2 jn 3 3 ^ 
n 2 i ns2 ~ nil mi 7 




(15) 



where n ± - is an element in the N matrix in the above equation 



Now referring to FIGURE 10, steps involved in one 
preferred process according to the current invention are 
illustrated in a flow chart. In a step 500, CCD values and 
sets of coefficients and equations are inputted. For 
example, the CCD values are in a RGB format while the 
coefficients are in a matrix format. A position index 
indicates a position of a pixel or photo sensor. After the 
position index i is initialized to zero in a step 501, a set 
of the coefficients and an appropriate equation set are 
selected based upon the position index in a step 502. For 
example, using a single- layered one -dimensional RGB photo 
sensor unit, the position is determined by a reminder of 
division by three. If a remainder is zero, the coefficients 
and the above equation (13) for a R photo sensor are 
selected. In a step 503, color image data is generated based 
upon the selected coefficient set and the selected equation. 

After the RGB value determination, in a step 504, a position 
is incremented by one for repeated the above described steps 
502 through 504 until every pixel data is finished in a step 



(4) . 
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505. When all the pixels are processed, in a step 506, the 
processed color image data is outputted. 

Referring to FIGURE 11, a second preferred embodiment 
of the color image improving system according to the current 
invention includes an image data input unit 400, a 
preprocessing unit 410, a smoothing filter unit 420, an 
intensity estimation unit 43 0, an edge filter 44 0, a RGB 
conversion unit 450, a gamma conversion unit 460 and a color 
image data output unit 470. The image data input unit 400 
inputs CCD data or photo sensor measured values. The 
preprocessing unit 410 interpolates the values based upon the 
measured values as well as converts the RGB values into 
chroma values Cr and Cb . The smoothing filter 420 generally 
smooths out the converted chroma values Cr and Cb . The 
intensity estimation unit 430 independently estimates an 
intensity value Y of a pixel in question based upon the 
original CCD data and the interpolated and smoothed 
chromaticity values Cr and Cb. The edge filter unit 44 0 
processes the estimated intensity Y values for sharpening 
edge areas. Finally, the RGB conversion unit 450 and the 
gamma conversion unit 4 60 respectively convert the edge 
filtered and the interpolated and smoothed chroma values Cr 
and Cb for outputting color image data via the color image 
data output unit 4 70. 

Referring to FIGURE 12A, one example of a two- 
dimensional single- layered photo sensor unit is illustrated. 

A letter indicates a color-specificity of the photo sensor 
while the corresponding number indicates a specific location. 

To interpolate color- specif ic values at a center position 
11, the above described preprocessing unit 410 uses the 
following equation set (16) to interpolate: 
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Rll = (R00 + R02 + R20 + R22) / 4 
Gil = (G01 + G10 + G12 +■ G21) / 4 
Bll = Bll 

(16) 

At other photo sensor element locations, by using a 
combination of masks or filters such as illustrated in FIGURE 
12B, interpolation values are obtained. The exemplary 
combinations of these masks are summarized in a table of 
FIGURE 12C. Depending upon a position in the photo sensor 
unit, an original CCD value is multiplied by a fraction, zero 
or 1 in a mask specified in the table. The above described 
preprocessing unit 410 also converts the RGB values into 
YCrCb values based upon the following equation set (17) : 

Y = KrR + KgG + KbB 

Cr=R-Y= (1- Kr) R - KgG - KbB 
Cb = B - Y = -KrR - KgG + (l-Kb)B 

(17) 

where Kr = 0.299, Kg = 0.587 and Kb = 0.114. 

An alternative embodiment of the preprocessing unit 
according to the current invention includes an filter for 
converting CCD data to CrCb values. The conversion is 
generally expressed by the following equation (18) : 
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CCD1 

Cr Crl Cr2 Cr3 
[ ] = [ ]*[CCD2] ....(18) 

Cb CblCb2Cb3 

CCDS 



For example, using a CCD array, conversion filters have type 
1, type 2 and type 3 and are arranged as illustrated in 
FIGURE 13A. A first filter mask as shown in FIGURE 13B 
generates Cr values while a second filter mask as shown in 
FIGURE 13C generates Cb values. The position of each CCD is 
independently taken into account in converting the CCD value 
into the chroma values Cr or Cb . 

Another alternative embodiment of the intensity 
estimation unit according to the current invention relies 
upon the following relation for example, for a filter type 1 
as described in equations (19) and (20) . 

y Cr Cg Cb R 

[Cr] = [l-CsubR-C G -CsJ'fG] 
Cb -Cr -CgJ'Cb B 

(19) 



CCD1 = R1^R + G^G + B1*B ....(20) 



where C R/ C G and C B are predetermined constants and Rl , Gl and 
1 are a portion of a matrix M in the following equation (21) 
by which the CCD values are converted to RGB values . The 
matrix M is determined based upon actual CCD measurements of 
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known or measured RGB color image under pre/determined 
conditions and minimal square approximation. 



CCD1 R 

[CCD2] = M*[G] (21) 

CCD3 B 



Rl Gl Bl 
M = [R2G2B2] 
R3 G3 B3 

By solving the above equations (19) and (20) for an estimated 
intensity value Y, the RGB matrix is now canceled as follows 
in equations (22) : 

Y = Yo • CCD J + y,»Cr + y 2 • Cb 
Yo = -C G /C 
Y^IRI'Cg-GI'CrJ/C 
Y 2 = (B1*Cg-G1*C b )/C 
C = -G1 + G1*Cr- RI'Cg- BJ»Cg + QJ» CsubB 

(22) 

Thus, by determining Y 0 , Y 1 and Y 2 for each filter type in 
advance, the intensity value is efficiently estimated based 
upon the CCD values and the chroma values Cr and Cb. 

Now referring to FIGURE 14, one preferred embodiment 
of the above described system for independently estimating an 
intensity value according to the current invention includes a 
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program storage device readable by a machine such as a 
central processing unit (CPU) 410 and a memory 412, tangibly 
embodying a program of instructions executable by the CPU 410 
to perform method steps of reproducing a high- resolution 

image. The program storage device further includes 
components such as a hard disk drive 416, a floppy disk 424, 
a floppy disk drive 422, and a remote storage unit accessed 
by a communication interface unit 420. The image software 
program from the above described storage unit improves the 
color image resolution, and the improved image is outputted 
to an output device such as a display unit 414 and a printer 
418 . 

It is to be understood, however, that even though 
numerous characteristics and advantages of the present 
invention have been set forth in the foregoing description, 
together with details of the structure and function of the 
invention, the disclosure is illustrative only, and that 
although changes may be made in detail, especially in matters 
of shape, size and arrangement of parts, as well as 
implementation in software, hardware, or a combination of 
both, the changes are within the principles of the invention 
to the full extent indicated by the broad general meaning of 
the terms in which the appended claims are expressed. 



